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Abstract — We consider the problem of noiseless and noisy low- 
rank tensor completion from a set of random linear measure- 
ments. In our derivations, we assume that the entries of the tensor 
belong to a finite field of arbitrary size and that reconstruction 
is based on a rank minimization framework. The derived results 
show that the smallest number of measurements needed for exact 
reconstruction is upper bounded by the product of the rank, 
the order and the dimension of a cubic tensor. Furthermore, 
this condition is also sufficient for unique minimization. Similar 
bounds hold for the noisy rank minimization scenario, except for 
a scaling function that depends on the channel error probability. 



I. Introduction 

The problem of matrix rank minimization (MRM) arises in 
many areas of signal processing, computer science, and com- 
munication theory, due to its close relationship to collaborative 
filtering, minimum-order system linearization, robust principal 
component analysis, and Euclidean embedding problems (TJ. 
In this setting, one is concerned with reconstructing a matrix 
from a set of (possibly noisy) linear measurements of the 
matrix. With each measurement, one associates a sensing 
matrix; a measurement represents the Frobenius inner product 
(i.e., the component-wise inner product) of the matrix under 
consideration and a sensing matrix. 

If the entries of the matrix are dependent and there are 
only a few factors that influence the relationship between 
the entries, the array will have low rank (or approximately 
low rank) compared to its size. The low-rank property allows 
for performing exact reconstruction using a number of linear 
measurements that is significantly smaller than the size of 
the matrix. If there exists a low-rank matrix consistent with 
the measurements, the MRM problem can be solved using an 
optimization method: find the matrix with the lowest rank that 
agrees with the measurements. Unfortunately, this problem is 
not convex (it is a combinatorial minimization problem) and 
is NP-hard so that relaxation techniques based on minimizing 
the sum of singular values are used instead [2|. The sum 
of singular values can be shown to be the tightest convex 
relaxation of the non-convex rank function (T). 

In many instances of the problem, the measurement matrices 
are restricted to the set of matrices with exactly one non- 
zero entry equal to one. In this case, the problem is known 
as low-rank matrix completion (LRMC) 0. Furthermore, for 
most applications, the entries of the (approximately) low- 
rank matrix are assumed to be real- or complex-valued, or 



in few rare instances, elements of a finite set of integers fl3]. 
An example of a low-rank approximation problem involving 
a discrete alphabet is the Netflix problem where a matrix 
is used to model the movie rankings of users, while two 
recent completion methods for matrices over finite fields were 
described in |4), 0. 

We consider extending the matrix minimization framework 
in two directions: first, we consider arrays (tensors) of di- 
mension greater than two. Such arrays frequently arise when 
studying three-dimensional data representations such as videos 
or multi-dimensional arrays that capture interaction profiles 
among sets of genes or their corresponding proteins |]6], El- 
Second, we consider tensors over finite fields, motivated by a 
new class of problems at the intersection of network coding 
and low rank completion J8). 

Our derivations are motivated by the recent work in [0, 
but they differ in so far that we consider tensors of order 
greater than two, we do not work in the central regime 
where the rank grows with the dimension of the matrix, and 
our measurement errors are induced by the g-ary symmetric 
channel where q denotes the order of the finite field with 
which we work. Similar to the work described in 0, we use 
information theoretic methods to establish the ultimate perfor- 
mance limits of the novel tensor rank minimization problem, 
and our reconstruction method is based on rank minimization, 
rather than on minimization of the sum of singular values. 
Information theoretic methods provide ultimate performance 
limit characterization for the minimization problem, and at the 
same time, they allow for characterizing typical instances of 
the problem. The latter property is of special interest in tensor 
rank minimization problems, since it is known that there exist 
many algorithmic problems associated with special instances 
of low -rank tensor approximation ||9]- 

Our results show that the smallest number of measure- 
ments needed for exact reconstruction is upper bounded by 
the product of the rank, the order, and the dimension of 
a cubic tensor - i.e., the number of degrees of freedom of 
the problem. Furthermore, this condition is also sufficient for 
unique minimization. Similar behavior is observed when the 
linear measurements are assumed to be noisy, as generated 
by a q-ary symmetric channel. In this case, an additional 
increase in the measurements is required that allows for exact 
minimization, and this overhead can be characterized in a 
concise mathematical manner. 



The paper is organized as follows. In Section [TT] we describe 
the matrix and tensor minimization model under consideration. 
The performance limits of the noise-free model for tensors of 
arbitrary rank and order are described in Section [ill] while the 
noisy case is analyzed in IIVI 

II. The Model 

We start by introducing the notation used in our analysis. 
Throughout the paper, tensors of order larger than one are 
denoted by bold uppercase letters and vectors are denoted 
by bold lowercase letters, while scalars and tensor entries are 
written in standard script. Calligraphic letters are used for sets 
and multisets. 

Let ¥ q be a finite field with q elements. For simplicity, we 
assume that q is a prime, so that ¥ q = {0, — 1}. We also 
use \n\ to denote the set {1, 2, • • • , n). 

A tensor of order d and size ni x n 2 x • • • x over ¥ q is a 
multidimensional array T G ¥ q ni x " 2X "' x "' i . A tensor A is of 
rank one if there exists vectors u"' G ¥ q nj , j G [d], such that 
A = u (1) <g> u (2) <g) • ■ • <g> u (d) = 0^ =1 u (i) ; here, the symbol 
"(g)" denotes the vector outer product, and all additions and 
multiplications are performed modulo q. An arbitrary tensor 
can be written as the sum of rank-one tensors. The rank of 
a tensor T is the smallest integer p > 1 such that there exist 
p rank-one tensors whose sum is equal to T (9|- With this 
definition, one has 

P d 



(1) 



t=l 3=1 

where G ¥ q nj for any i G [p] and j G [d]. For convenience, 
the rank of an all-zero tensor is assumed to be zero. 

Assume that rij — n for j G [d). In this case, the set of 

xd 

all tensors of order d with entries in ¥ q equals F g . We let 
T(n; d; r; q) denote the set of tensors T G ¥ q n with rank at 
most r. We are given to linear (and possibly noisy) measure- 
ments of a tensor T , where the measurements are obtained 
using m sensing tensors. Let M = {M (1) ,M (2) , ■ • • ,M (m) } 
denote the multiset of the to sensing tensors, where G 
¥ q n is the fc th sensing tensor; each sensing tensor is sampled 
with replacement from the set of all possible tensors in ¥ q , 
independent of other sensing tensors and independent of T . 
The sampling distribution is uniform. We also assume that 
T is chosen uniformly at random from T(n; d; r; q). We are 
concerned with the necessary and sufficient conditions on the 
smallest value of to needed to uniquely reconstruct T . 

We consider two scenarios: noise-free measurements and 
noisy measurements. In each scenario, we provide necessary 
and sufficient conditions needed to perfectly reconstruct T us- 
ing the vector of measurements. It is worth mentioning that the 
perfect reconstruction of a tensor using noisy measurements 
is only possible because the entries of the tenors are chosen 
from a finite field, provided that the number of measurements 
is allowed to grow unboundedly; in the general case where the 
entries are real numbers, perfect reconstruction is impossible 



and the best estimate according to an appropriate cost function 
is sought instead. 

In the noise-free scenario, we denote the vector containing 
the noise-free measurements by y G ¥ q m ; the fc th entry of y 
equals the tensor inner product [9 1 of T and MP*', given by 
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M W ,T 



< fc L,..., l£ r n , l2 ,..., 4d ke [m] 



E 
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In the noisy scenario, the vector of noisy measurements is 
denoted by y. We model the effect of noise by considering 
y to be the output of a g-ary symmetric memoryless channel 
with error probability e and input y. More precisely, for any 
i G [to], yi — yi with probability 1 — e and jji equals any 
symbol in ¥ q — {yi} with probability e/(q — 1). 

We find the following lemmas useful for our subsequent 
derivations. 

Lemma 1 (Upper Bound): For any d > 2, the size of 
T{n\d\r\q) is upper bounded by q dnr , i.e. \T(n; d;r; q)\ < 

qdnr 

Proof: Let T G T(n; d; r; q) be a tensor of rank p < 
r. Such a tensor can be written as the sum of p rank-one 
tensors (as shown in (fl]i) and r — p rank-zero tensors, i.e. 



T = EI=i <8>Li «i . where »i £ Since each entry of 

(A) 

is chosen from an alphabet of size q, there exist q n distinct 
vectors that can be used in the outer product. As a result, there 
are at most q dn distinct tensors of rank at most one with the 
given order. This proves that \T(n; d; r;q)\ < q dnr . ■ 
This upper bound is usually loose; however, it is sufficiently 
tight for the arguments used in this paper. 

Lemma 2 (Lower Bound): For any d > 3, the size of 



T(n; d; r; q) is lower bounded by 



Cq°_ 



r r (q— l) r (° 



— for some pos- 

Cq d " 



itive numerical constant C, i.e. \T(n; d; r;q)\ > pr^^yR^r) ■ 
Proof: It was proved in [10] that 

|T(n; d; r; q)\ 



> 1 
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One can show that rj,Co ~ 9*) = ^ UtZoi 1 - ^~") > 
c q q ns , where c q = JJZii 1 ~ 1 ) > c 2 ~ 0-3. Let C = c\. 
Then, 



\T(n;d;r;q)\ > 1 + 



s=l 



> 1 



q n - 1 
9-1 
Cq d 



s(d-2) 



Cq 2 



> 



s s (q - l) s 

Cq dnr 



(q-l)s(d-l) rr( g _l)r(cJ-l)' 



This proves the claimed result. ■ 

Remark 1: Lemma [2] provides a lower bound on the size of 
T(n; d; r; q) whenever d > 3. For matrices (i.e., tensors with 
d = 2), a similar lower bound can be found in ifTTI . and it 
reads as \T(n;2;r;q)\ > q ( 2 n-2)r-r 2 _ 



III. Noise-free Scenario 

In what follows, we focus on the case of noise-free obser- 
vations y. 

A. Converse 

We first derive a necessary condition to uniquely reconstruct 
the tensor T £ Tin; d; r; q) using y and A4. Our bounds hold 
for any values of d and r. 

For a given value of m and a reconstruction function <?(•, ), 
we denote the tensor reconstructed using the measurements 
of T by T = g(y,M), and the probability of incorrect 
reconstruction as P e = Pr ^ T . 

In addition, we use H (T) to denote the Shannon's entropy 
of the distribution that governs the choice of T, and by 
I(T ; T) the mutual information between T and T. 

Theorem 1 (Converse I): Let d > 3. In order for the 
probability of error to converge to zero as n — > oo, one must 
have m asymptotically larger than nrd ~ r^^. 



nrd 



Proof: From Fano's inequality JT2), one has 
H(T\y,M)-l 



P P > 



log(|T(n;d;r;g)| 



(2) 



One can show that 

H(T) ( = ] H(T\M) ( =' I(T* ; y\M) + H(T* |y, M) 

^ H{y\M) - H(y\T , M) + H(T \y, M) 

where (a) follows from the fact that T is independent from 
any member of M., and (b) and (c) follow from the definition 
of mutual information. Consequently, one has 

H(T\y,M)=H(T)-H(y\M) + H(y\T,M). (3) 

Since y is a function of T and Ai, 

H(j\T',M)=0. (4) 

Moreover, T is chosen uniformly at random from 
T(n; d; r; q) and therefore 

H(T* )=log(|T(n;d;r;g)|). (5) 

Using the chain rule and the fact that conditioning does not 
increase the entropy, one can show that 



H(y\M) < >H(yi) <mlogg. 



i=l 

If we substitute eqs. OJ-© into eq. (0, we obtain 

> \og(\T(n;d;r;q)\) - to log q - 1 
log(\T(n;d;r;q)\) 
A vanishing probability of error requires that 

\og(\T(n;d;r;q)\) - 1 



(6) 



m > 



\ogq 



( a ) \og(C) + nrd\ogq — r\ogr — r{d—\) log(<7— 1) — 1 
log (J 

where (a) follows from Lemma |2] and where C is the numeri- 
cal constant defined in the same lemma. Therefore, as n — >• oo 
one must have m asymptotically larger than 



logr 
\ogq' 



(7) 



Remark 2: Note that if d = 2, using Remark [2] one must 
have to > 2nr — r 2 as n — > oo. 

B. Achievability 

Next we derive sufficient conditions to recover a low-rank 
tensor T using noise-free linear measurements y. 

Let y T £ F™ denote a vector whose fc th entry is equal to 
y Tk = (M (fc) ,T), for any T £ F g ™ Xd ; using this definition, 

y T * = y- 

We introduce the following reconstruction method (hence- 
forth referred to as decoder), 



T = arg min rank(T) 
subject to y T = y. 



(8) 



Among all the tensors T e F," that are consistent with the 
measurements, the decoder chooses the one with the lowest 
rank, T. Since the tensor T itself satisfies the condition in 
dHJ, one must have rank(T) < r, and we can limit the search 
to the set of tensors with rank at most r, T(n; d; r; q). 

We define the error event E to be the event that there exists 
at least one tensor, other than T , with rank at most r that 
satisfies the conditions in ([8j, i.e., 

£= (J {y T = y}- (9) 

T: T^T*, rank(T)<r 

Theorem 2 (Achievability I): If to > C\nrd for any numer- 
ical constant C\ where C\ > 1, then the probability of error, 
Pr(£'), converges to zero as n tends to infinity. 

Proof: Using the union bound, one has 
Pr(-B) = Pr | |J {y T = y} < £ Pr (y T = y) . 

\T: T^T*, rank(T)<r / T: T^T* , rank(T)<r 

For any fixed T and T such that T ^ T , 
Pr(yT =y)= Pr (<W fc) , t\ = (M {k) , T* ^ , Vfc e [to] ' 
( = } Pr ((mW.t) = (m^ 1 )^*) , Vfc £ [to] ; 
# of choices of M (1) for which (m (1) , T - T*\ = 



total number of choices for M 



where (a) follows from the fact that the sensing tensors 
are chosen independently and with an identical uniform dis- 
tribution. Since T ^ T , at least one of the entries of 
T T is nonzero. Since any nonzero element in a finite 
field has a unique multiplicative inverse, a simple counting 
argument shows that among all the possible realizations of 
M (1) , only a fraction q- 1 of them satisfy ^M (1) ,T - T*\=0. 
Consequently, 



Pr(E) < I'" 

T: T/T*, rank(T)<r 



(a) 



= q- m \T(n-d-r;q)\ < g~< 



where (a) follows from Lemma Q] As a result, if m > C\nrd 
where C\ > 1, then Pi(E) converges to zero as n — y oo. ■ 



IV. Noisy Scenario 



A. Converse 



Let the reconstructed tensor be given by T = f{y,M), 
where /(•,) denotes the reconstruction function. We de- 
fine the probability of incorrect reconstruction as P e = 
Pr (T ^ T*). 

Theorem 3 (Converse II): Let d > 3. In order for the 
probability of error to converge to zero as n — > oo, one 



nrd 



log r 
log? 



(10) 



must have m asymptotically larger than A(e, q) 
where A(e, q) is a function that only depends on e and q. 
Proof: From Fano's inequality, one has 

H(T\y,M)-l 
log(\T(n;d;r;q)\) ' 
Also, using an argument similar to the one used in Theorem Q] 
one can show that 

H(T*\y,M) = H(T) - H(f\M) + H(y\T , M), (11) 

where H(j") = log(\T(n; d; r; q)\) and H(y\M) < m\ogq. 
Moreover, one has 

H(y\T,M) ® H(y\T,M,y) ( = } H(y\y) 



(c) 



H{yi\y) + H(y 2 \yi,y)i 
+ H(y m \yi,y2, 



,y m -i,y) 



= ^2 H (vi\yi) - mH (i/i\yi) 



i=l 



(/) 



9-1 



ni 



Y J H{y 1 \y 1 =i)P Y {y 1 ^i) (12) 

j=0 

where (a) follows from the fact that y is a function of T and 
M, (b) follows from the fact that given y, the value of y is 
independent of T and Ai, (c) follows from the chain rule, (d) 
and (e) follow from the fact that the channel is memoryless, 
and (/) follows from the definition of conditional entropy. In 
addition, 

9-1 

H{yi\yi = i) = -^P{yi=j\yi=i)\ogP{yx=j\y\ = i) 

3=0 

= -(! - e ) l°g(l - e) - elog - 

9-1 

= h(e)+e\og(q-l) (13) 



where h (e) = — e loge— (1 — e) log(l — e) is the binary entropy 
function fl2| . Combining ( TTZb and ( fT3l . one obtains 



9-1 



H(y\T ,M)=m (h(e) + e log (q - 1)) ^ P Y ( yi 



i) 



= m[h{e) + elog (?-l)]. (14) 
Upon substituting eqs. (fTTb and ( TT4T > into eq. ( [Tol l, we obtain 



Pe> 



log(|T(n; d;r; q)\) — mlogq+mh(e)+mclog(g— 1) — 1 



log(|T(n;d;r;g)|) 
For P e to converge to zero, one must have 
log(|T(n;(f;r;?)|)-l 



m > 



(15) 



log? - /i(e) - elog(g - 1 
If ci > 3, using Lemma [2] (fl~5T > simplifies to 

log(C)+nrd logq — r log r — rid— 1) log(q — 1) — 1 

772 ^> 

logq - /i(e) - elog(g- 1) 
where C is the numerical constant defined in the same lemma. 
Therefore, as 77 , — > 00 one must have m asymptotically larger 
than 



A(e,g) 



nrd — r 



log r 



where 



AM) 



logq 
log (J 



logg- /i(e) - e\og(q - 1)' 



(16a) 
(16b) 



Remark 3: Using RemarkQ] it can be easily shown that when 
d = 2, in order for the probability of error to converge to 
zero as 77 — y 00, one must have m asymptotically larger than 

A(e,g)(277r - r 2 ). 

B. Achievability 

As previously explained, we assume that the vector of 
noisy measurements, y, is the output of a q-ary symmetric 
memoryless channel with error probability e and input y. We 
introduce the following decoder, 



T = arg min rank(T) 
subject to d H (y T ,y) < r 



(17) 



where du(-, •) denotes the Hamming distance and t = r(m) 
is a properly chosen positive integer. In other words, among 
all the tensors T g F, for which the vector of noise-free 
measurements is within a "small" Hamming distance from the 
noisy measurement of T , the decoder chooses the one with 
the lowest rank, T. Clearly, the choice of r depends on the 
error probability of the channel. The goal is to choose r and 
m such that T is the only tensor with rank at most r that 
satisfies the consistency conditions and dn(yj,y) < r. 

We define an error event E to be the event that the Hamming 
distance between y and y is larger than r or that there exists at 
least one tensor other than T with rank at most r that satisfies 
the conditions in (fTTb . i.e., 

E= (J {d H (y T ,y) <r} U {d H (y,y) > r}. (18) 

T: T#T*, rank(T)<r 

Let b T £ {0, l} m be a random indicator vector whose k th 
entry is equal to 

1 if y Tk ^ yk 

if y Tk = yk- 

Similarly, we define the indicator vector b T € {0, l}™ 1 as a 
random vector whose fc th entry is equal to 

1 if y Tk ¥= yk 
if y Tl . = yk- 



Lemma 3: For any fixed tensor T such that T ^ T , the 
random variables b Tk , k £ [to], are independent identically 
distributed (i.i.d.) and have a Bernoulli distribution with pa- 
rameter Pr(& Tfc = 1) = 1 — |. 

Proof: For any k 6 [m], one has 

Pr(b Tk = 0) =Pr(6 Tfc = 0|6 Tfc = 0) Pr(6 Tfc = 0) 

+ Pr(6 Tfc =0\b Tk = l)Pr(fo Tfc = 1). 

From the counting argument in Theorem we know that 

Pr(6 Tfc = 0) = i and Pr(fe Tfc = 1) = Also, one has 



and 



As a result, 



Pr(6 Tfc = 0|6 Tfc = 0) = (1 - e) 
Pr(6 T = 0|V =l) = -i_. 



Pr(& T = 1) = 1 - Pr(6 T = 0) = 1 



(1-e) 



9-1 



q q q 

and therefore the random variables 6 Tfc 's, k 6 [to], are 
identically distributed and have a Bernoulli distribution with 
parameter Since each MS k > is chosen independently from 

¥ q n , the random variables 6 Tfc for k £ [to] are independent. 
In addition, since the channel is memoryless, the random 
variables 6 Tfc 's are independent as well. ■ 

Lemma 4: The random variables b * , k £ [to], are i.i.d. and 

Bernoulli distributed with parameter Pr(6 , = 1) = e. 

T fc 

Proof: The proof is straightforward and consequently 
omitted. ■ 
In the next theorem, we provide sufficient conditions for 
reconstructing the tensor T using the decoder ([T7i > in the 
asymptotic regime. 

Theorem 4 (Achievability II): Let e < 1 — |, and choose 
r = mrj, where e < r\ < s= —. For this choice of r, if m > 
C2j(e,q)nrd, where j(e,q) is a function of q and e only 
and C2 > 1 is an arbitrary numerical constant, then Pi(E) 
converges to zero as n tends to infinity. 

Proof: Using the union bound, one has 
Pr(£)=Pr |J {dff(y T ,y)<r} u {d H (y,f)>T}\ 

\T: T/T*, rank(T)<r / 

< Pr(d ff (y T ,y)<r) + Pr(d ff (y,y)>r). 

T: T^T*, rank(T)<r 

It can be easily seen that the event {dff(y x ,y) < i~} is 
equivalent to the event {J2T=i — T i- Using Hoeffding's 
inequality [ 1 3 1 and Lemma [3] if r < m^-, then one has 



Pr(tfe(y x ,y)<r)=Pr [J^K <r }< 



(19) 

Similarly, the event {dniy, y) > t} is equivalent to the event 
{J2T= i ^ * > T l- Using Hoeffding's inequality and Lemma[U 



if r > me, then one has 

Pr (d H (y , y) > r) < Pr (d H (y, y) > r) 



< Pr [ V b » > r I < e~ 2 (T ^° . (20) 

" ViS Tfe " / " 

Since e < 1 — |, for large enough values of m we can set 
r = 7/to, where e < r] < 1 — | and where r is a positive 
integer. This choice of r satisfies the conditions of eqs. (fT~9b 
and ( f20b . Consequently, 



Pr(£) < e - 2m ("- e )" + ^ J " ! 

T: T^T*, rank(T)<r 
2m(i)-e) 2 +e nrdlogq-2m[(i 5 i)-i,] 2 



(a) 

< e" 



(21) 



where (a) follows from Lemma 03 The first term in (|2H 
converges to zero as m tends to infinity. The second term 
also converges to zero provided that 

to > C2"f(e,q)nrd, (22a) 

where 

log q log q 



7(^9) 



> 



9-1 



*7 



(*?) 



(22b) 



and C2 > 1 is a numerical constant. ■ 
Theorem [4] shows that for the smallest alphabet size, q = 2, 
the decoder (TTTb can reconstruct a tensor from a noisy vector 
of measurements if e < |. For large values of q, the decoder 
can reconstruct tensors from noisy measurements when e is 
strictly less than one. Clearly, this noise tolerance comes at 
the cost of an increased number of measurements, as A(e, q) 
grows quadratically with the inverse of the difference between 



^- and e. 

1 



References 



[I] B. Recht, M. Fazel, and P. A. Parrilo, "Guaranteed Minimum-Rank 
Solutions of Linear Matrix Equations via Nuclear Norm Minimization," 
SUM Rev., vol. 52, pp. 471-501, Aug. 2010. 

[2] E. J. Candes and B. Recht, "Exact matrix completion via convex opti- 
mization," Found, of Comput. Math., vol. 9, pp. 717-772, 2009. 

[3] ACM SIGKDD and Netflix, "Proceedings of KDD Cup and Workshop", 
2007. 

[4] S. Vishwanath, "Information theoretic bounds for low-rank matrix com- 
pletion," in Int. Symp. Inf. Theory, Austin, TX, July 2010. 

[5] V. Y. F. Tan, L. Balzano, and S. C. Draper, "Rank Minimization over 
Finite Fields," http://homepages.cae.wisc.edu/~vtan/isitl l.pdf 

[6] J. De Las Rivas and C. Fontanillo, "Protein-Protein Interactions Essen- 
tials: Key Concepts to Building and Analyzing Interactome Network," 
PLoS Computational Biology, vol. 6, June 2010. 

[7] A. Emad, W. Dai, and O. Milenkovic, "Protein-Protein Interaction Pre- 
diction using Non-Linear Matrix Completion Methods," to be presented 
at RECOMB'2011, Vancouver, Canada, March 2011. 

[8] V. Skachek, A. Emad, and O. Milenkovic, "A New Framework for Joint 
Network and Error-Control Coding", manuscript in preparation. 

[9] T. G. Kolda and B. W. Bader, "Tensor Decomposition and Applications," 
SIAM Rev., vol. 51, pp. 455-500, 2009. 

[10] R. M. Roth, "Tensor Codes for the Rank Metric," IEEE Trans. Inf. 
Theory, vol. 42, pp. 2146-2157, Nov. 1996. 

[II] P. Loidreau, "Properties of codes in rank metric," ArXiv:0610057, 2006. 
[12] T. M. Cover and J. A. Thomas, Elements of Information Theory, 2nd 

ed., New Jersey: Wiley, 2006. 
[13] W. Hoeffding, "Probability Inequalities for Sums of Bounded Random 
Variables", J, Amer. Statist. Assoc., vol. 58, pp. 13-30, 1963. 



